P4.26 


IMPROVED THIN CIRRUS AND TERMINATOR CLOUD DETECTION IN CERES CLOUD MASK 


Qing Trepte 

Science Applications International Corporation 
Hampton, VA 

Patrick Minnis 

NASA Langley Research Center, Hampton, VA 

Rabindra Palikonda and Doug Spangenberg 
Analytical Services and Materials, Inc. 
Hampton, Virginia 

Martial Haeffelin 

Lab. de Meteorologie Dyn., IPSL, Palaiseau, France 


1. Introduction 

Thin cirrus clouds account for about 20-30% of the 
total cloud coverage and affect the global radiation 
budget by increasing the Earth's albedo and reducing 
infrared emissions. Thin cirrus, however, are often 
underestimated by traditional satellite cloud detection 
algorithms. This difficulty is caused by the lack of 
spectral contrast between optically thin cirrus and the 
surface in techniques that use visible (0.65 pm) and 
infrared (1 1 pm) channels. 

In the Clouds and the Earth’s Radiant Energy 
System (CERES) Aqua Edition 1 (AEdl) and Terra 
Edition 3 (TEd3) Cloud Masks, thin cirrus detection is 
significantly improved over both land and ocean using a 
technique that combines MODIS high-resolution 
measurements from the 1 .38 and 1 1 pm channels and 
brightness temperature differences (BTDs) of 11-12, 
8.5-11, and 3.7-11 pm channels. To account for 
humidity and view angle dependencies, empirical 
relationships were derived with observations from the 
1 .38 pm reflectance and the 11-12 and 8.5-1 1 pm BTDs 
using 70 granules of MODIS data in 2002 and 2003. 

Another challenge in global cloud detection 
algorithms occurs near the day/night terminator where 
information from the visible 0.65 pm channel and the 
estimated solar component of 3.7 pm channel becomes 
less reliable. As a result, clouds are often 
underestimated or misidentified near the terminator over 
land and ocean. 

Comparisons between the CLAVR-x (Clouds from 
Advanced Very High Resolution Radiometer [AVHRR]) 
cloud coverage and Geoscience Laser Altimeter System 
(GLAS) measurements north of 60 °N indicate significant 
amounts of missing clouds from CLAVR-x because this 
part of the world was near the day/night terminator 
viewed by AVHRR. Comparisons between MODIS cloud 
products (MOD06) and GLAS in the same region also 
show similar difficulties with MODIS cloud retrievals 
(Pavolonis, 2005). The consistent detection of clouds 
through out the day is needed to provide reliable cloud 
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and radiation products for CERES and other research 
efforts involving the modeling of clouds and their 
interaction with the radiation budget. 

The twilight cloud detection algorithms in the 
CERES cloud mask have been improved using both 
MODIS and Geostationary Operational Environmental 
Satellite (GOES) data. Because Terra and Aqua are 
polar-orbiting satellites, MODIS sees twilight regions 
mostly at high latitudes and often over snow surfaces. 
An improved twilight algorithm utilizes MODIS 2-km 
multi-spectral measurements: visible 0.65 and 1 .6 pm 
(2.1 pm for Aqua) reflectances, 11 pm brightness 
temperatures, and the 3.7-11 and 6.7-11 pm BTDs to 
differentiate between clouds and snow surfaces. With 
the TE3d cloud mask, the MODIS derived global cloud 
fraction shows a smoother transition from the 
midlatitudes into polar regions. 

Unlike polar orbiting satellites, geostationary 
satellites (GOES 10 and 12) provide continuous 
temporal sampling over low and midlatitudes and a 
good opportunity to examine how cloud 
detection/retrieval algorithms work at all local times. The 
GOES cloud detection algorithm is based on the 
CERES TEd2 cloud mask. Because of spectral 
differences between GOES and MODIS, threshold 
adjustments have been made for application to the ARM 
(Atmosphere Radiation Measurement) GOES 
measurements. This adjusted cloud mask algorithm is 
designated the CERES ARM Cloud Mask (CACM). The 
original version of the CACM is VI. 1. The improved 
version is called V2.1. It is used for real-time GOES 
cloud retrievals (Minnis et al. , 2004) over the continental 
United States (CONUS) and environs (55°N-20°S and 
1 30°W-65°W). The GOES cloud detection algorithm 
utilizes the 4-km GOES VIS reflectance, 10.8-pm 
brightness temperatures, and the BTDs for 3.9-1 1 pm 
and 6.7-10.8 pm, 10.8-13 pm (for GOES-12), and 10.8- 
12 pm (for GOES-10), together with the predicted 
background clear-sky information to detect various 
types of clouds and snow (in winter seasons). The 
results show improvement in cloud amount over the 
ARM Southern Great Plains (SGP) site. The improved 
near-terminator is validated using Micropulse Lidar 
(MPL) observations and the Millimeter-Wavelength 
Cloud Radar (MMCR) measurements at SGP site. 



2. Data and Methodology 

This study uses Terra and Aqua MODIS and 
GOES-10, and 12 radiance measurements. The 
ancillary data used here include the atmospheric profiles 
and surface skin temperature: Goddard Modeling and 
Assimilation Office (GMAO) data for CERES 
operational, hourly Rapid Update Cycle (RUC; Benjamin 
et al., 2004) sounding data over U.S. for GOSE 
processing, daily snow and ice maps from the NOAA 
Satellite Services Division (SSD); 1 0’ surface emissivity 
maps at 3.9 and 1 1 pm derived from MODIS data (Chen 
et al. 2004); CERES clear-sky VIS reflectance maps 
derived from MODIS (Sun-Mack et al., 2003); IGBP 
(International Geosphere Biosphere Program) 
ecosystem map; water percentage and surface 
elevation maps. 

The CERES cloud mask is used as the scene 
identification method for the operational CERES 
products (Trepte et al., 1999). The technique is based 
primarily on a cascade of threshold tests utilizing the 
radiances taken at 0.65, 3.9, 6.5, 11, and 12.0 or 13.3 
pm compared with the predicted clear-sky 0.65-pm 
reflectance, 11 -pm top-of-atmosphere (TOA) Tn, and 
TOA Ta^Tn. Clear-sky albedo maps, directional and 
bidirectional reflectance models (Sun-Mack et al., 2004) 
are used to predict the expected clear-sky reflectances. 
Clear-sky TOA brightness temperatures T cs are 
estimated from surface skin temperature for 3.7, 10.8 
and 12-pm channels using the surface emisssivities and 
computing the atmospheric effects on the upwelling 
radiance using temperature and humidity profiles. The 
clear-sky maps are resolved to 10’ of latitude and 
longitude. Thresholds are based on spatial and temporal 
variation within a 10” box. The scenes are classified as 
clear or cloudy with additional subcategories. Clear 
categories include strong, weak, smoke, fire, snow, sun- 
glint, shadow, and aerosol. Cloudy classifications 
include strong, weak, sun-glint. The strong and weak 
refer to the certainty of the classification. 

2. 1 CERES-MODIS daytime thin cirrus detection 

Surface validation using ground-based lidar at 
SIRTA, France (Chiriaco et al. 2005), shows that the 
Terra Edition 2 (TEd2) CERES cloud mask 
underestimates thin ice clouds over land. In TEd2, the 
traditional visible channels, 0.65 and 1.6 ?m, together 
with IR channels were used to detect various clouds. 
For very thin cirrus, the reflectances from 0.65 and 1.6 
?m have little contrast compared with their background 
clear sky values. In the AEdl cloud mask (CERES 
operational since 2004) and the TEd3 cloud mask 
(planned operational start date in late 2006), a new 
daytime thin cirrus detection algorithm was developed 
using MODIS 1.38-pm reflectance (pi. 3 s), together with 
the 3.75-11, 11-12, and 8.5-11 pm BTDs. Since pi. 38 , 
Tii— T12, and Ts.s-Tn vary with water vapor loading in the 
atmosphere and satellite view angles, empirical 
relations of p i . 33 , T11-T12, and T&s-Tn as functions of 
atmospheric column precipitable water (PW) and view 
angles (VZA) were developed. The study was based on 


70 5-minute granules of MODIS data over various land 
and desert surfaces and PW was calculated from 
GMAO profiles. It was found that the VZA dependency 
of pi .38 and T 8 . 5 -Tii was Isss significant than the PW 
dependency; thus, these dependencies are not 
considered further. Figure 1 displays the polynomial fits 
of pi.38_PW, Tn-Ti2_PW, and T 8 .5-Tn_PW as functions 
of PW for clear-sky conditions. 

The daytime thin cirrus tests over land and desert 

are: 

1 ■ P 1.38 > (pi.38_PW+ 0.002) 

2. For land: Tn - T 12 > Tucs- Ti 2 cs- 0.5 

or T 11 -Ti 2 >Ci_thr 

For desert: Tn - Ti 2 > Tn - Ti 2 _PW 
or Tn - Ti 2 > Ci_thr 

3. T 8 . 5 — Tn > T 5 . 5 — Tn_PW + 1 

4. T 3.7 -Tn > (T 3 . 7 CS - Tucs) + 1 

where T 3 .7cs, Tn cs and Ti 2 CS are predicted clear sky TOA 
temperatures and Ci_thr is the Tn and VZA dependent 
thresholds. If a pixel passes all four tests, it is classified 
as cloudy. 

Over ocean, a pixel is classified as cloudy when 

Tcsii- Tn > 2.5 K 
p 1.38 > 0. 008 
Tn - Ti 2 > Ci_thr 
Tn - Ti 2 > Tcsii - Tcs 12 . 

These tests are not sensitive to sun glint over ocean. 
The Tcsii-Tn > 2.5 K test sometimes prevents detection 
of very thin cirrus due to its very weak IR signature. 

2.2 GOES twilight cloud detection 

In previous CACMV1.1 analyses, it was found that 
as the sun approaches the day/night terminator (solar 
zenith angle, SZA > 70°), the CACMV1.1 mask missed 
stratus clouds off the California coast and sometimes 
over the central CONUS. In the "twilight zone" (82° < 
SZA < 87.5°), “clear bands” often crossed the 
continental U.S.. Several improvements have been 
made based on evaluations of the CACMV1.1 cloud 
mask to correct these problems. The newer CACM 
version, V2.1 developed here, uses VIS reflectance, 
together with the IR channels and the snow map as 
outlined below. 

A pixel is classified cloudy if, 

Over snow- free land: 
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Fig. 1. Functional dependencies of p 1.33, T11-T12, and 
T 8 . 5 -Tii with precipitable water. 


If p ?m> (p cso .65 + 0 . 10 ) and 
((T3.9- Tu> 1 and T C sii - Tu) or T3.9— Tu< - 1 ) 

Over snow surface: 

If T 3.9 - Tn> (T C s3.9 - Tcsii + 0 . 75 * 039 ) and T C sii - Tu 
> 0.5*O‘&nd$?0.65> P csO.65 + 0. 10). 

Over water: 


If p 0.65 > (p cso.65 + 0.05 andpo. 65 > 0.20 and T cs ii - 
Tu > 0 or Tcsii - Tu > 1 .5*oii . 

where?po .65 is VIS reflectance, CS refers to clear-sky, 
and ? is the uncertainty in the clear-sky estimate. 

Additionally for GOES-1 2: 

Tu — T13 <10 and (T3.9 — Tu > 3 or T3.9 — Tu < - 

0.5). 

If no clouds are detected by the above cloud tests, a 
pixel will be assigned as clear snow, where T S kin<277K 
and snow map > 0. 

During daytime with high SZAs (70° < SZA < 82°), 
T3.9 - Tu thresholds were refined to account for the 
cancellation of 3.9 pm reflected solar component in 
order to detect more low clouds over land and ocean. 

2.3 CERES-MODIS twilight polar cloud detection 

MODIS sees twilight mostly at high latitudes. The 
twilight polar cloud tests were developed for CERES 
TEd2 (Trepte, et al, 2002) and further improved in TEd3. 
In addition to the 0.65-pm visible reflectance, the ratio of 
1 .6 to 0.65 pm (2.1 to 0.65 for Aqua) was also used in 
MODIS Terra and Aqua twilight algorithms. The 
theoretical snow reflectance models of 0.65, 1 .6, 2.1 pm 
were used as clear sky values over snow surfaces. 

3. Results 

The impact of the changes in the mask are 
illustrated with the aid of a few examples showing 
comparisons with the old CERES mask, results from the 
Collection 4 MOD06 mask (Ackerman et al., 2000), and 
with objective surface measurements. 

3. 1 Thin cirrus detection 

Figure 2 shows the CERES cloud mask results 
compared with ground-based lidar measurements at 
SIRTA observatory (Figure 3) near Palaiseau, France 
(indicated by a small red box in the middle of the i mage) 
on 6 November 2003. The CERES TEd3 mask identifies 
more thin cirrus than with TEd2. Note the cloud layer at 
1 1 :40 AM was observed between 1 0-1 1 km by the lidar. 
Figure 4 shows a comparison between the traditional 
thin cirrus cloud detection in TEd2 with the improved 
algorithm in TEd3 at the SIRTA observatory. The upper 
right panel represents a composite MODIS image of 
0.65, 1.6, and 3.7-11 pm. The TEd2 cloud mask and 
clear categories are shown on the lower portion of the 
left column and the TEd3 results are on the right 
column. Not only does TEd3 identify more clouds, it also 
detects more snow (red in RGB image) that was 
previously misidentified as clouds by TEd2. 

Figure 5 compares the CERES TEd2, TEd3, and 
MOD06 cloud masks. CERES TEd3 significantly 
improves thin cirrus detection in comparison with TEd2 
and MOD06. Both TEd2 and MOD06 have similar 
results. In addition, snow was detected more accurately 
over the Sierra Nevada by TEd3. 
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Clear cloudy TED Bad data 

Fig. 2. Terra MODIS, 6 November 2003, 1 140 UTC, SIRTA, France. Top right: composite image using 0.65, 1.6, and 
3.7-11 pm: Bottom panels: CERES cloud mask TEd2 (left) and TEd3 (right). 
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Fig. 3. LNA lidar cloud mask for Nov. 6, 2003, 1140 UTC, at SIRTA observatory. " flag = 0: no significant power return, 
flag = 1: molecular, flag = 2: boundary layer, flag = 3: aerosol layer, flag = 4: cloud layer, flag = 4: no detection". 
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Fig. 4. Terra MO DIS imagery. 2 April 2002, 0955 UTC, at the SIRTA observatory in France. The top color bar 
represents the CERES Cloud Mask and the bottom color bar represents the clear category. 
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Fig. 5. Terra MODIS imagery, 6 March 2005, 1920 UTC, near San Francisco, California. 


An example of improvement in the AEdl thin cirrus 
detection is shown in Fig. 6. The thin cirrus off the 
California coast was completely missed by CERES 
TEd2 (applied to Aqua data) and MOD06, but was 
detected by the CERES AEdl . However, some very thin 
cirrus was still under-detected by AEdl due to weak IR 
signals. 

3.2. Improved twilight cloud detection 

Figure 7 compares the performance of CACM VI .1 
and V2.1 in near-terminator conditions off the California 
coast. The top two panels are GOES-10 IR and VIS 
images. The SZAs vary between 65 and 82°. The warm 
stratus clouds produce very weak signal in IR image, 


but are evident in the VIS image. By refining the 
cloud test for large SZAs, the V2.1 detects the warm 
status that was missed by VI. 1. In this case, the 
inclusion of more weight for the VIS reflectance 
thresholds in the decision results in dramatic 
improvements in the CACM in low sun conditions. 

Figure 8 shows a cyclone crossing the midwestern 
U.S. during the twilight period. The infrared channels- 
based VI. 1 mask missed the warm clouds over the 
northern plains since the IR signals are small. The new 
twilight cloud tests, applied when 82° < SZA < 87.2°, 
which use the VIS reflectance together with new 10.8- 
pm and BTD thresholds to significantly improve the 
twilight cloud mask, reduced the “clear band” as seen in 
VI .1 mask. 




Fig. 6. Aqua MODIS, 27 October , 2003, 2055 UTC, off North California coast. See color bar for Fig. 5. 
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Fig. 8. GOES-12, 7 December 2004, 2015 UTC. 




Fig. 9. Terra MODIS, 30 July, 2005, 0040 UTC, Greenland and Baffin Bay. See color bar for Fig. 5. 


An example of improvement in twilight low cloud 
detection for TEd3 compared with TEd2 and MOD06 is 
shown in Figure 9. The top-left panel is a composite 
RGB image (0.65, 1 .6, 3.7-1 1 jim) and the SZA ranges 
from 77 to 89°. TEd3 picked up the low clouds in Baffin 
Bay that were under-detected by TEd2. The MOD06 
mask missed some low cloud over Greenland, and also 
has striping across day-night terminator, a common 
problem for global cloud detection algorithms that also 
affects CERES global cloud fraction in some months. 


Figure 10 shows the CERES daytime global cloud 
fraction for May 2004. In early summer at high northern 
latitudes, Sun angles are often low. Discontinuities are 
sometimes found for latitudes between 50 to 60°N. This 
example shows a discontinuity line crossing Siberia in 
TEd2 (top plot with arrow). In AEdl (bottom plot), the 
discontinuity at the same location was improved. 
Flowever, in some months, CERES AEdl daytime and 
nighttime global cloud fraction plots still have 
discontinuity lines which needs further improvements. 




Fig. 10. Daytime monthly global cloud fraction for May 2004, top: CERES TEd2; bottom: CERES AEdl. 


3.3. Validation at SGP site 

The CACM VI .1 and V2.1 cloud fractions for 31 
January and 20 February 2005 were compared with 
cloud detections at the ARM Southern Great Plains 
(SGP) Central Facility. The results are shown in Fig. 1 1 . 
The mean CACM retrieved cloud amount was 
calculated for a 20-km x 20-km box centered at SGP 
using GOES-10 data. Micropulse Lidar (MPL) 
measurements at SGP site are also plotted for the same 
time period. 

At local twilight and during nighttime (00-14 UTC), 
theV2.1 cloud mask increases the cloud amount by 10- 
90% on 31 January and by roughly 50% on 20 February 
with some exceptions. The MPL indicates that the cloud 
cover is relatively heavy throughout the day on the 31 st , 
but around 1345 UTC (twilight) in Fig. 1 1 the V2.1 cloud 
fraction drops to 0.2 and returns to overcast in the next 
image. Except for this anomaly, the observations match 


well with the cloudy and clear portions throughout 31 
January. The agreement is relatively good at night on 
the 20 ttn (Fig. 12), but not during daytime. The cloud 
height is extremely variable, even extending up to 20 km 
suggesting the cloud heights are interpreted form noise 
in the MPL returns. In Fig. 13, the SGP MMCR 
reflectivity imagery and GOES-10 RGB imagery at four 
different times show clear skies over the SGP during the 
daytime (14 - 20 UTC) on 20 February 2005, which 
agrees well with the V2.1 results. Most of the newly 
detected clouds from V2.1 are at very low altitudes. 

4. Conclusions and Future Work 

The TEd3 and AEdl CERES cloud mask improved the 
thin cirrus cloud detection over both land and ocean 
using Terra and Aqua MODIS 1 .38 pm, and other visible 
and IR channels. The GOES CACM V2.1 cloud mask 







Fig. 1 1. Top: Comparison of cloud fraction at SGP site 
between CACM VI. 1 and V2.1, 31 January 2005; 
Bottom: MPL measurements of cloud heights. 


UTC(hr) 

Fig. 12. Top: Comparison of cloud faction at SGP site 
between CACM VI. 1 and V2.1, 20 February, 2005. 
Bottom: MPL measurements of cloud heights. 


improved the cloud detection near the day/night 
terminator where the observed T 3.7 - T 11 signals are 
weak due to cancellation of the reflected solar 
component of 3.9 pm and the lack of contrast in the 11- 
pm channel for warm low clouds. Twilight cloud tests, 
which utilize the GOES visible and IR channels, smooth 
the transition between daytime and nighttime cloud 
retrievals. The cloud fraction from the improved GOES 
cloud mask agrees well with surface measurements 
from MPL and MMCR data at ARM SGP site. MODIS 
twilight polar improvements in AEdl and TEd3 reduced 
the discontinuities at day/night terminator and smoothed 
the transition between mid and high latitudes. 
Additional enhancements are needed for the CERES 
and GOES cloud masks over snow-covered mountains, 
shadows of high-over-low clouds, dust over desert and 
ocean, smoke over the Gulf of Mexico, and clouds over 
bright desert regions. More accurate estimates of clear 
sky visible, skin temperature, and surface emissivity are 
also necessary for further gains in cloud detection 
accuracy, especially at night. These future changes in 
the cloud mask will be intensely scrutinized with 
observations at all of the ARM surface sites. 
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